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In communication 
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Promotes collaboration 














Helps negotiations 




In the arts 
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In design 



Dy thtf author of The Design of Everyday Things 
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Our descent then, is the origin of our evil 
passionsil- Charles Darwin, textbook, Gruber & 
Barrett, 1974, p. 289 
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What are emotions? 


• a conscious mental reaction (as anger or fear) 
subjectively experienced as strong feeling usually 
directed toward a specific object and typically 
accompanied by physiological and behavioral changes 
in the body [Dictionary MerrianWebster] 

• But understanding emotions is difficult... 

- After a century of research, there is still no consensus about 
what are emotions and how to communicate them [Picard] 
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A feeling that underlies behaviors and comprised of 
-Physiological (autonomic arousal) 

- Behavioral (non-verbal expression) 

- Cognitive (subjective feelings) 
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Why study emotions? 


• Research on Human Sciences shows the 
importance of emotions in human behaviour 

- [Damasio] emphasizes this aspect of human behaviour 

- Creativity and emotion are strongly related. 

- Memory and emotion are strongly related 


• Plus, Human-Technology interaction is naturally 
social and as such, emotion should be a part of 
it. 
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Descartes’ error 
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• According to Descartes(1569-1650) there was a 
clear separation between the rational and the 
irrational. 




Damasio] defends that reason and emotion cannot 
be seen as antagonic entities in our mind. 
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Early Theories of Emotion 


Common Sense View 

- When you become happy, your heart starts beating 
faster. First emotion, then physiological activity 
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James-Lange Theory 

( 1884 ) 



Emotion is a 
result of 
physiological 
responses to 
stimuli 

We are sad 
because we cry, 
afraid because 
we tremble . . . 


Stimulus Res P° nse Emotion 

(heart rate, etc) 


Responses percede emotions 

Situation> Interpretation of the brain > Physiological 
Reaction > Cognition > Emotion 
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James-Lange theory 


Testing the theory: 

• Hypothesis 1: You need the body in order 
to feel emotions. 

• Test: Interview people with high vs. low 
spinal cord injuries 

High spinal cord injury: 

“Sometimes I act angry... But it doesn’t have 
the heat to it that it used to. It’s a mental kind 
of anger.” 


Hohman, 1966, pp. 150-151 (Carlson) 
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James-Lange theory 


Situation -> bodily reaction -> emotion 



LOVE? 
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James-Lange theory 


• Testing the theory: 

• Hypothesis 1: You need the body in order to feel 
emotions 

- Results 1: The body may be necessary to have a full 
emotional experience. 

• Hypothesis 2: The body can tell you 
precisely which emotion to feel. 

- Test: Gave people a dose of adrenaline: 


“I feel as if I’m angry or afraid” 
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James-Lange theory 


Testing the theory: 

• Hypothesis 1: You need the body in order to 
feel emotions 

- Results 1: The body may be necessary to 
have a full emotional experience. 

• Hypothesis 2: The body can tell you precisely 
which emotion to feel. 

- Results 2: The body is not ALL that is 
necessary to have a fully emotional experience. 
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Cannon-Bard Theory of 

Emotion 


- Physiological arousal and 
emotion (subjective 
feelings) occur 
simultaneously 

- Heart begins pounding as 
we experience fear 


r Sight of ^ 

oncoming car 
(perception of stimulus) 



Cannon-Bard Theory 



^Pounding heart^ 

(arousal) 




Fear 

(emotion) 




lis c b n oa° Schachter-Singer Theory 


Stanley Schachter and 
Jerome Singer proposed 
yet another theory 
which suggests our 
physiology and 
cognitions create 
emotions. Emotions 
have two factors- 
physical arousal and 
cognitive label. 


r Sight of 
oncoming car 
(perception of stimulus) 



Schachter's 
Two-Factor Theory 


Cognitive label 


Tm afraid" 
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3. The Schachter theory 



• Situation 


-> bodily reaction -> emotion 
+ cognitive appraisal 
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Characteristics of Emotion 


Dimensions of emotion 
(valence and arousal) 

Function and structure 

• Emotion as a “motivator” 

• Facial feedback hypothesis 

(e.g. Ekman, Levenson, & Friesen, 1983) 

•Action tendencies (Frijda, 1986) 
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Paul Ekman’s Research on 

Emotions 


• Primary Emotions 

1) Are evident in all cultures 

2) Are based in survival 

3) Correlate with facial expressions 

• Secondary All other emotions that are particular to 
humans and specific cultures 

• Six primary emotions happiness, surprise, sadness, 
fear, disgust and anger (and degrees) Ekman 
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Anger 

Disgust 

Fear 

Paul Ekman 
on the 
universality 
of Emotions 
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Sadness 

Surprise 
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Paul Ekman: FACS 
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Different Theories: Basic 

Emotions 



Basic Emotions 

Basis for Inclusion 

Arnold 

Anger, aversion, courage, 
dejection, desire, 
despair, fear, hate, 
hope, love, sadness 

Relation to action 
tendencies 

Ekman, Friesen e 
Ellsworth 

Anger, disgust, fear, joy, 
sadness, surprise 

Universal facial 
expressions 

Frijda 

Desire, happiness, interest, 
surprise, wonder, 

sorrow 

Forms of action readiness 

Gray 

Rage and terror, anxiety, 

joy 

Hardwired 

James 

Fear, grief, love, rage 

Bodily involvement 

Mowrer 

Pain, pleasure 

Unlearned emotional states 

Panksepp 

Expectancy, fear, rage, 
panic 

Hardwired 

Watson 

Fear, love, rage 

Hardwired 

-29- 













Lfs C B N oA° Appraisal Theories: 

Cognition and Emotion 


What is the connection between how we 
think (cognition) and how we feel 

(emotion)? 


Can we change our emotions by changing 

our thinking? 
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Appraisal Theories 


- Appraisal characterizes the assessment of 
the relationship between the person and 
their physical and social environment. 

- This appraisal is clearly subjective and is 
made regarding the agent’s desires, goals, 
standards, values, and attitudes. 



Situation> lnterpretation> Evaluation (appraisal) 
> Emotion 
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Cognitive-Appraisal Theory 


• Sequence 

- Situation/Stimulus (object, event, or thought) 

- Appraisal of how this affects your well-being (consciously or 
unconsciously) 

- Emotion (fear, anger, happiness, ...) 

- Physiological responses and behavior 

• For an emotion to occur, it is necessary to first think about 
the situation. 
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Why Appraisal Theories? 


• Appraisal Theories: 

- Emotions are preceded and 
generated by a cognitive appraisal 

- The appraisal system has evolved to 
predict the most adequate response 
to a situation and elicit the 
appropriate emotion 


^lisboa 0 Affective Computing and 

Agents: Common Goals 

1. To make machines less frustrating to interact with 

- Interface agents 

- Agents that interact with humans 

2. To conceive robots and synthetic characters that 
can emulate humans or animals 

- Believability of agents 

3. To study human emotions by modeling them 

- Psychological and social simulations 

4. To improve machine intelligence 

- More intelligent and resource-effective agents 
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Emotional Agents 


• Aspects to consider 


- Emotional 
Perception 

- Emotional 
Reasoning 

- Emotional 
Memory 

- Emotional 
Learning 

- Emotional 
Expression 
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Emotional Agents 



How to define an agent that is 
emotional? 
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Emotional Agents 



An emotional agent is an agent that interacts 
with its environment based on valenced 
evaluations of the impact that the states of 
that environment have on the goals, beliefs 
and overall concerns of that agent. 










^ LISBOA 0 Relating with the Existing 

Architectures 



• Deliberative Architectures 


• Hybrid Architectures 






^lisboa 0 Relating with the Existing 

Architectures 

• Emotions will have an impact on: 

- Perception (the see function) 

- Beliefs (the brf function) 

- Reasoning and Decision Making 
(deliberation and means-ends 
reasoning) 

- Action and Expression 


TECNICO 

LISBOA 


Agent Control Loop Version 7 


1. 

2. 

B /?□; 

3. 

• 

II 
■ 1 

4. 

while true do 

5. 

get next percept p; 

6. 

B := brfiB.p); 

7. 

D := options(B. I) ; 

8. 

l--mer(B.D.l); 

9. 

7r := plan(B. I); 

10. 

while not ( enipty(ir) 

11. 

or succeeded^!, B) 
or impossible^, B)) do 
o := hd(ir) ; 

12. 

exeeute(ck) ; 

13. 

tt := tail(w ); 

14. 

get next percept p; 

IB. 

B := brfXB. p) ; 

16. 

if recons uteri I.B) then 

17. 

D := options (B, I) ; 

18. 

/ :=filter {B, D. I) ; 

19. 

end-if 

20. 

if not sound(TT, /. B) then 

21. 

tt := pkw{B, /) 

22. 

end-if 

23. 

end-while 

24. 

end-while 
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2. 



3. 

/ / u; Affective 


4. 

while true do Sensing 


5. 

get next percept p; 


6. 

B := hrfXB . p ); 


7. 

D := options(B. I) ; 


8. 

I z=filter(B. D. /) ; 


9. 

7T := plan(B. I); 


10. 

while not ( empty(ir) 

or succeededfJiB ) 
or impossible^, B)) do 


11. 

o := hd(rr) ; 


12. 

ermrfe(a) ; 


13. 

tt := tail{w ); 


14. 

get next percept p; 


IB. 

B'-brj\B,p); 


16. 

if reconsider(I,B) then 


17. 

D z= options (B, I) ; 


18. 

/ :=filter {B, D. I) ; 


19. 

end-if 


20. 

if not soiwd(Tr.l.B) ther 


21. 

tt z= pkw{B, I) 


22. 

end-if 


23. 

end-while 


24. 

end-while 
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1 . 

2. 

B:= B a ; 


3. 

/ -= /a; 


4. 

while true do 


5. 

get next percept /»; Affective 


6. 

7. 

B := ht'HB.p ); _ . 

Dz^optionsiBJ); Revision 


8. 

/ := filter{B, D. I) ; 


9. 

7T := plan(B. I); 


10. 

while not ( empty(ir) 

or succeededfj, B ) 
or impossible^, B)) do 


11. 

• 

£ 

II 

• • 

W 


12. 

ermtfe(a); 


13. 

tt := taiHw ); 


14. 

get next percept p; 


IB. 

B := hrf(B. p ); 


16. 

if reconsider(I f B) then 


17. 

D := options [B. I) ; 


18. 

/ :=filter {B, D. I) ; 


19. 

end-if 


20. 

if not soutuI{tt, /. B) then 


21. 

tt := pkw(B, I) 


22. 

end-if 


23. 

end-while 


24. 

end-while 
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Agent Control Loop Version 7 


1. 

2. 

B := /?□; 


3. 

• 

II 
■ 1 


4. 

while true do 


5. 

get next percept p; 


6. 

B --hrrtB.p); 


7. 

D := options(B. I ); 

Appraisal 

8. 

/ := filteiiB, D, 1) ; 


9. 

7r := plan(B. I); 


10. 

while not ( empty(ir) 



or succeededfj, B ) 


or impossible^, B)) do 

11. 

• • 

II 

rv 

** • 


12. 

exeeute(ck ); 


13. 

tt := tail(w ); 


14. 

get next percept 

p; 

IB. 

B := />/;/!( B. p ); 


16. 

if reconsiiler(f.B) then 

17. 

D := options [B. I ); 

18. 

/ filter [B. D. I) 

m 

$ 

19. 

end-if 


20. 

if not 50M/K/(7r f /. B) then 

21. 

tt := phw(B, /) 


22. 

end-if 


23. 

end-while 


24. 

end-while 
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Agent Control Loop Version 7 


1. 

2. 

B:= B a ; 

3. 

/ := /a; 

4. 

while true do 

5. 

get next percept p; 

6. 

B := brjXB.p ); 

7. 

D:=options(B t I); Affective 

8. 

/ := filterifi, D, I) ; Deliberation 

9. 

7r := plan(B. I); 

10. 

while not ( empty(ir) 

11. 

or succeededfJiB ) 
or impossible[I.B ’)) do 
o := hd(ir) ; 

12. 

exeeute(ck) ; 

13. 

tt := tail(w ); 

14. 

get next percept p; 

IB. 

B := brf(B. p ); 

16. 

if reconsider(I f B) then 

17. 

D := options (B, I) ; 

18. 

/ :=filter {B, D. I) ; 

19. 

end-if 

20. 

if not soundiitm /-5) then 

21. 

tt := pkw(B, I) 

22. 

end-if 

23. 

end-while 

24. 

end-while 
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Agent Control Loop Version 7 


1. 



2. 

B := /?□; 


3. 

• 

II 
■ 1 


4. 

while true do 


5. 

get next percept p; 

6. 

B := brfiB.p); 


7. 

D := oplions(B. 1) ; 


8. 

/ :—ftlhr(B. D. 1) ; 


9. 

r := phinl li. 1); 


10. 

while not ( ernpty(ir) 


or succeeded^!, B) 


o r impossihie (/. /?)) do 

11. 

& 

• ■ 

II 

rv 

M 

• 


12. 

exeeute((i) ; 

Expression 

13. 

tt := tail(w ); 


14. 

get next percept p; 

IB. 

B := brjXB.p) 

• 

i 

16. 

if reconsider^,B) then 

17. 

D := options (B. I) ; 

18. 

/ filter (B. D. /); 

19. 

end-if 


20. 

if not soune/faiI 9 B) then 

21. 

tt := pkw{B, /) 

22. 

end-if 


23. 

end-while 


24. 

end-while 
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What about the reactive 
dimension of emotion? 


lisboa 0 Emotional Agents as 

Hybrid Architectures 



perceptual input 


action output 




















lisboa 0 A Generic Appraisal- 

based Architecture 
















































Emotional Architectures 
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Some Examples 
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Behavior 


SystemX 




Motor 

System 



(Interna A 
l Stimuli J 


Emotion 
Generation 



Actions 


♦ 

■ 

♦ 


l 


t 


External 

Stimuli 


External World 


♦ 

■ 

♦ 


Cathexis 
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Cathexis 


• Basic Emotions 

- Anger 

- Fear 

- Sadness 

- Joy 

- Disgust 

- Surprise 

• Basic emotions are families of 
emotional states 

(e.g. Fear, Terror, Panic, are from the Fear family) 


IP 


TECNICO 

LISBOA 


Simon, the Toddler 




Simon the Toddler 
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Agent's State 
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Yuppy 
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Emotivector 


• Our perceptions guide our attention, which 
in turn affects our perception... 

• Our emotions guide our perception that in 
turn affects our emotions.... 
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Salience 

module 

(emotivectors) 


Emotivector 


Percept Prediction 

Anticipation model 

Percept Salience 

Attention model 

Percept Sensation 

Affective model 











IP 


TECNICO 

LISBOA 



Aini 
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iCat 
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LIVING WITH ROBOTS 

AND INTERACTIVE COMPANIONS 
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FAtiMA 


• Based on the OCC theory of Emotions 

• Emotions are generated through an 
appraisal process 

• Emotions affect: 

- Reasoning 

- Planning 

- Actions 
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FAtiMA 


Reactive Layer 


Appraisal 


Action Tendencies 


Knowledge Base 



Perception 
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Vision. 


• We know that “scripted” animated characters 
can make users respond emotionally 





But can we create autonomous characters 
that also evoke emotional responses from 
users? 
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FearNot! 


• Evaluated with 1000 children in Germany 
and UK 

• Reduction of victimization rate 



The purpose of this video is to showcase some of the cultural 
differences found in this intercultural training system named Traveller 




LisEOA 0 Animating an emotional 

robot! 
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Socially Present 
Agents 

for 

Tabletop Games 


Perguntas? 




